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(57) [Abstract] 
[Problem to be Solved] 
15 To provide a surveillance method that enables small 

scale individuals to simply conduct surveillance. 
[ Solution] 

When a sensor 110 senses the presence of a person 
and the like, and when a transmission instruction is 

20 obtained from an observer side terminal 300, a 

photographing side terminal 130 generates an e-mail 
including a monitored image photographed by a digital 
camera 120, and transmits the e-mail to an observer 
through the Internet 200. The observer can see the 

25 monitored image by receiving the e-mail. 
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[Claims for the Patent] 
[Claim 1] 

A surveillance method, characterized by comprising: 

receiving an input of transmission destination 
information for identifying a transmission destination; 

previously registering the inputted transmission 
destination information; 

generating data including a photographed monitored 
image when an abnormality is sensed by a sensor; and 

transmitting the generated data to the transmission 
destination identified based on the registered 
transmission destination information . 
[Claim 2] 

The surveillance method according to claim 1, 
characterized in that 

the data including the photographed monitored image 
is generated in an e-mail format, and the generated e- 
mail is transmitted to a previously-registered 
transmission destination address. 
[Claim 3] 

The surveillance method according to claim 2, 
characterized in that 

the sensor is a human-body-sensing sensor, and when 
a human body is sensed by the sensor, an e-mail including 
the photographed monitored image is generated. 
[Claim 4] 

A surveillance method, characterized by comprising: 
receiving instruction information for instructing a 
monitored image to be transferred; 
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generating an e-mail including a photographed 
monitored image when receiving the instruction 
information; and 

transmitting the generated e-mail to a previously- 
5 registered transmission destination address. 
[Claim 5] 

The surveillance method according to any one of 
claims 2 to 4, characterized in that 

the e-mail including the monitored image further 
10 includes recorded sound data. 
[Claim 6] 

A surveillance method, characterized by including: 
generating a file including a photographed monitored 

image and identification information specified for each 
15 observer who desires surveillance when an abnormality is 

sensed by a sensor; 

transferring the generated file to a server; and 
outputting the monitored image from the sever based 

on the transferred file in response to a request 
20 accompanying the identification information. 

[Claim 7] 

A surveillance method, characterized by including: 
receiving an instruction information for instructing 

a file including a monitored image to be transmitted; 
25 generating a file including a photographed monitored 

image and identification information specified for each 

observer who desires surveillance when receiving the 

instruction information; 

transferring the generated file to a server; and 
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outputting the monitored image from the sever based 
on the transferred file in response to a request 
accompanying the identification information. 
[Claim 8] 

5 A surveillance apparatus, characterized by 

including : 

inputting means for receiving an input of 

transmission destination information for identifying a 

transmission destination; 
10 registering means for registering inputted 

communication destination information; 

generating means for generating data including a 

photographed monitored image when an abnormality is 

sensed by a sensor; and 
15 transmitting means for transmitting the generated 

data to a transmission destination identified based on 

the transmission destination information registered by 

said registering means. 

[Claim 9] 

20 The surveillance apparatus according to claim 8, 

characterized in that 

the data including the photographed monitored image 

is generated in an e-mail format, and said transmitting 

means transmits the generated e-mail to a previously- 
25 registered transmission destination address. 

[Claim 10] 

A surveillance apparatus, characterized by 
including : 
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inputting means for receiving an input of 

transmission destination information for identifying a 

transmission destinations- 
registering means for registering inputted 
5 communication destination informations- 
receiving means for receiving instruction 

information for instructing a monitored image to be 

transmitted; 

e-mail generating means for generating an e-mail 
10 including a photographed monitored image when receiving 
the instruction information; and 

transmitting means for transmitting the generated e- 
mail to a transmission destination identified based on 
the transmission destination information registered by 
15 said registering means. 
[Claim 11] 

The surveillance apparatus according to claim 9 or 
10, characterized in that 

the e-mail further includes recorded sound data. 
20 [Claim 12] 

A computer-readable recording medium, characterized 
by recording a surveillance program for causing a 
computer to execute: 

an obtaining step for obtaining a photographed 
25 monitored image; 

a generating step for generating an e-mail including 
the photographed monitored image when an abnormality is 
sensed by a sensor; and 
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a transmitting step for transmitting the generated 
e-mail to a previously-registered transmission 
destination address . 
[Claim 13] 

A computer-readable recording medium, characterized 
by recording a surveillance program for causing a 
computer to execute: 

an obtaining step for obtaining a photographed 
monitored image; 

a receiving step for receiving instruction 
information for instructing the monitored image to be 
transmitted; 

a generating step for generating an e-mail including 
the photographed monitored image when receiving the 
instruction information; and 

a transmitting step for transmitting the generated 
e-mail to a previously-registered transmission 
destination address . 
[Claim 14] 

A surveillance information providing method for 
providing surveillance information using a computer 
system, characterized by comprising: 

setting and registering identification information 
specified for each observer who desires surveillance, and 
an address of a monitored location where photographing 
means is installed, the information and the address being 
previously associated with each other; 

prompting the observer to input the identification 
information; 
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when the inputted identification information matches 
the set and registered identification information, 
allowing the observer to select output of the current or 
past surveillance information; 

when the current surveillance information is 
selected to be outputted, providing an instruction to 
transmit newly obtained surveillance information to the 
address of the monitored location corresponding to the 
inputted identi f i cat ion information, 

receiving the surveillance information transmitted 
in response to the instruction; 

outputting the received surveillance information to 
the observer; 

on the other hand, when the past surveillance 
information is selected to be outputted, reading the 
surveillance information from a file in which the 
surveillance information, autonomously transmitted from 
the monitored location in response to an abnormality 
being sensed, and the identification information of the 
observer are sequentially stored, the surveillance 
information and the identification information being 
associated with each other; and 

outputting the read surveillance information to the 
observer . 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] 

The present invention relates to a surveillance 
method, a surveillance apparatus, a recording medium in 
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which a surveillance program is recorded, and a 
surveillance information providing method. 
[0002] 

[ Conventional Art ] 
5 Japanese Patent Laid-Open No. 11-339167 discloses an 

example of a conventional image surveillance system. The 
image surveillance system described in this publication 
transmits an image photographed by a camera installed at 
home or at an office to a security center apparatus, 
10 which provides for centralized surveillance. 
[0003] 

[Problems to be Solved by the Invention] 

However, the system described in the above 
publication needs a centrally monitoring, dedicated 

15 security center apparatus. And also, it is necessary to 
allocate a dedicated guard in a place where the security 
center apparatus can be operated. Thus, the system 
described in the above publication is suitable to a large 
scale organization, such as a security company, for 

20 providing security services, but is not suitable to 
general personal users for easily monitoring the 
circumstance inside a room where no person is present, 
and the like. 
[0004] 

25 On the other hand, currently, the Internet and a 

mobile communication can be widely used at home and at an 
office. Thus, it is convenient to be able to easily 
monitor the circumstance inside a room where no person is 
present, and the like, by utilizing an e-mail and a web 
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site which can be used on the Internet, and a mobile 

communication technology . 

[0005] 

The present invention has been made to solve the 
above problem, an object of the present invention is to 
provide a surveillance method that enables small scale 
individuals to simply conduct surveillance, a 
surveillance apparatus, a recording medium in which a 
surveillance program is recorded, and a surveillance 
information providing method. 
[0006] 

[Means for Solving the Problems] 

The object of the present invention is achieved by 
the following configuration. 
[0007] 

(1) A surveillance method according to the present 
invention is characterized by including: receiving an 
input of transmission destination information for 
identifying a transmission destination; previously 
registering the inputted transmission destination 
information; when an abnormality is sensed by a sensor, 
generating data including a photographed monitored image; 
and transmitting the generated data to the transmission 
destination identified based on the registered 
transmission destination information . 

[0008] 

(2) The above data including the photographed 
monitored image is generated in an e-mail format, and the 
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generated e-mail is transmitted to a previously- 
registered transmission destination address. 

(3) The above sensor is a human-body-sensing sensor, 
and when a human body is sensed by the sensor, an e-mail 

5 including the photographed monitored image is generated. 
[0009] 

(4) The surveillance method according to the present 
invention is characterized by including: receiving 
instruction information for instructing the monitored 

10 image to be transmitted; when receiving the instruction 
information, generating an e-mail including the 
photographed monitored image; and transmitting the 
generated e-mail to the previously-registered 
transmission destination address. 

15 [0010] 

(5) In the above (2) to (4), the e-mail including 
the monitored image further includes recorded sound data. 
[0011] 

(6) The surveillance method according to the present 
20 invention is characterized by including: when an 

abnormality is sensed by a sensor, generating a file 
including the photographed monitored image and 
identification information specified for each observer 
who desires surveillance; transferring the generated file 
25 to a server; and in response to a request accompanying 

the identification information, outputting the monitored 
image from the sever based on the transferred file. 
[0012] 
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(7) The surveillance method according to the present 
invention is characterized by including: receiving the 
instruction information for instructing a file including 
a monitored image to be transferred; when receiving the 
instruction information, generating a file including the 
photographed monitored image and the identification 
information specified for each observer who desires 
surveillance; transferring the generated file to a 
server; and outputting the monitored image from the sever 
based on the transferred file in response to a request 
accompanying the identification information. 

[0013] 

(8) A surveillance apparatus according to the 
present invention is characterized by including: 
inputting means for receiving an input of the 
transmission destination information for identifying a 
transmission destination; registering means for 
registering inputted communication destination 
information; generating means for generating data 
including the photographed monitored image when an 
abnormality is sensed by a sensor; and transmitting means 
for transmitting the generated data to a transmission 
destination identified based on the transmission 
destination information registered by the registering 
means . 

[0014] 

(9) The above data including the photographed 
monitored image is generated in an e-mail format, and the 
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transmitting means transmits the generated e-mail to the 
previously-registered transmission destination address . 
[0015] 

(10) The surveillance apparatus according to the 
present invention is characterized by including: 
inputting means for receiving an input of the 
transmission destination information for identifying a 
transmission destination; registering means for 
registering inputted communication destination 
information; receiving means for receiving instruction 
information for instructing the monitored image to be 
transmitted; e-mail generating means for generating an e 
mail including the photographed monitored image when 
receiving the instruction information; and transmitting 
means for transmitting the generated e-mail to a 
transmission destination identified based on the 
transmission destination information registered by the 
registering means . 

[0016] 

(11) In the above (9) or (10), the e-mail further 
includes recorded sound data. 

[0017] 

(12) A computer-readable recording medium according 
to the present invention is characterized by recording a 
surveillance program for causing a computer to execute: 
an obtaining step for obtaining the photographed 
monitored image; a generating step for generating an e- 
mail including the photographed monitored image when an 
abnormality is sensed by a sensor; and a transmitting 
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step for transmitting the generated e-mail to the 
previously-registered transmission destination address . 

(13) The computer-readable recording medium 
according to the present invention is characterized by 
5 recording a surveillance program for causing a computer 
to execute: an obtaining step for obtaining the 
photographed monitored image; a receiving step for 
receiving instruction information for instructing the 
monitored image to be transmitted; a generating step for 
10 generating an e-mail including the photographed monitored 
image when receiving the instruction information; and a 
transmitting step for transmitting the generated e-mail 
to the previously-registered transmission destination 
address . 

15 (14) A surveillance information providing method 

according to the present invention is a surveillance 
information providing method for providing surveillance 
information using a computer system, and is characterized 
by including: setting and registering identification 

20 information specified for each observer who desires 
surveillance, and an address of a monitored location 
where photographing means is installed, the information 
and the address being previously associated with each 
other; prompting the observer to input the identification 

25 information; when the inputted identification information 
matches the set and registered identification 
information; allowing the observer to select output of 
the current or past surveillance information; when the 
current surveillance information is selected to be 
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outputted, providing an instruction to transmit newly 
obtained surveillance information to the address of the 
monitored location corresponding to the inputted 
identification information; receiving the surveillance 
information transmitted in response to the instruction; 
outputting the received surveillance information to the 
observer; on the other hand, when the past surveillance 
information is selected to be outputted, reading the 
surveillance information from a file in which the 
surveillance information, autonomously transmitted from 
the monitored location in response to an abnormality 
being sensed, and the identification information of the 
observer are sequentially stored, the surveillance 
information and the identification information being 
associated with each other; and outputting the read 
surveillance information to the observer. 
[0018] 

[Embodiments of the Invention] 

Embodiments of the present invention will be 
described in detail below referring to the drawings. 

[First Embodiment ] 

The first embodiment relates to a case where the 
surveillance is conducted by transmitting an e-mail 
including an image (hereinafter, referred to as 
"monitored image") photographed at a monitored location 
to an observer. 

[0019] 
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Figure 1 is a block diagram illustrating a network 
configuration to which a surveillance method of the 
present embodiment is applied. 
[0020] 

5 A monitoring unit 100 is a unit installed at the 

monitored location, and is communicatively connected to a 
terminal on an observer side (hereinafter, referred to as 
"observer side terminal") through the Internet 200. As a 
result, surveillance information such as the monitored 
10 image and a sound, which are obtained by the monitoring 
unit 100, is transmitted to the observer side terminal 
through the Internet 200. 
[0021] 

The observer side terminal includes any terminals 
15 which can be connected to the Internet 200. For example, 
the observer side terminal includes a terminal 300 
connected to the Internet 200 through a public line 
network 210, a portable phone and a mobile terminal 310 
connected to the Internet 200 through a mobile 
20 communication network 220, a cable TV receiver 320 

connected to the Internet 200 through a cable television 
network 230, and an internet TV receiver (interactive TV 
receiver) 330 connected to the Internet through an 
internet broadcasting network 240. Meanwhile, in the 
25 following description, the present embodiment will be 

described by exemplifying the terminal 300 connected to 
the Internet 200 through the public line network 210 as 
the observer side terminal. 
[0022] 
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Next, a configuration of the monitoring unit 100 of 
the present invention will be described. 
[0023] 

The monitoring unit 100 is provided with a sensor 
110, a digital camera 120, a photographing side terminal 
130, a sound-collecting microphone 140, and a security 
alarm 150 . 
[0024] 

The sensor 110 is, for example, a pyroelectric 
sensor and an infrared light sensor sensing the presence 
of a person such as an intruder. A general water- 
detecting sensor sensing water leak and the like, a glass 
breaking sensor sensing a pressure change when glass is 
broken, and the like can be used as the sensor 110. 
[0025] 

The digital camera 120 functions as photographing 
means installed at a monitored location. In the present 
invention, a commercially available digital camera can be 
directly used as the photographing means. In view of 
saving electric power consumption, it is desirable to 
configure the camera so that the electric power is turned 
on only when the sensor 110 senses an intruder and the 
like, and an instruction for starting the photographing 
is received from the photographing side terminal 130. 
[0026] 

The photographing side terminal 130 is a terminal 
connected to the digital camera 120, and for example, is 
a normal personal computer. When the sensor 110 senses 
the presence of a person, the photographing side terminal 
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130 obtains an image photographed by the digital camera 
120, generates an e-mail including the obtained image and 
the like, and transmits the generated e-mail and the like 
to a previously-registered transmission destination 
5 address through the Internet 200. Meanwhile, as the above 
observer side terminal, the photographing side terminal 
130 may be a normal personal computer, a portable phone, 
a portable terminal, a cable TV receiver, an internet TV 
receiver, and the like. 
10 [0027] 

The sound-collecting microphone 140 is used to 
record a surrounding sound, and the security alarm 150 
issues an alarm when a sensor senses an intruder and the 
like . 
15 [0028] 

Meanwhile, the terminal 130 on the monitoring target 
side and the observer side terminal 300 can be connected 
to the Internet 200 through an internet provider, and can 
communicate with a mail server 400 for transmitting and 
20 receiving an e-mail and with a World Wide Web server 500 
providing a web site. 
[0029] 

Figure 2 is a block diagram describing an internal 
configuration of the photographing side terminal 
25 corresponding to the monitoring unit of the present 
embodiment . 
[0030] 

Controlling means 10 includes a CPU (central 
processing unit), and controls the photographing side 
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terminal 130 as a whole. Meanwhile, the photographing 
side terminal 130 includes a RAM temporarily storing data, 
a ROM storing a control program, a hard disk which can 
record a variety of programs and data files, and the like, 
5 which are not illustrated respectively. 
[0031] 

A peripheral device interface 20 is an interface for 
communicating with the sensor 110, the digital camera 120, 
and the sound-collecting microphone 140. On the other 

10 hand, the network interface 30 is an interface for 

connecting to the Internet 200 through the public line 
network 210 and the like. For example, as the network 
interface 30, a terminal adapter (TA) and a digital 
circuit terminating apparatus (DSU) may be used, or a 

15 modem may be used. 
[0032] 

A main program 40 is, for example, installed in a 
hard disk. This main program 40 is executed by the 
controlling means 10 to perform a variety of functions. 
20 [0033] 

The main program 40 will be described for each 
function module. The main program 40 includes a waking-up 
module 41, an e-mail analyzing module 42, an e-mail 
automatic generating module 43, and an e-mail automatic 
25 transmitting receiving module 44, and the like. 
[0034] 

The waking-up module 41 receives a signal from the 
sensor 110 sensing an abnormality such as the presence of 
a person and the water leak, and wakes up the following 

- 18 - 



English translation of Japanese Patent Laid-Open No. 2002-042273 

e-mail automatic generating module 43 and the like. The 
waking-up module 41 can also wake up the e-mail automatic 
generating module 43 and the like by receiving, from the 
observer side terminal 300 and the like, an instruction 
e-mail for instructing the monitored image to be 
transmitted . 
[0035] 

The e-mail analyzing module 42 is software for 
deciding whether or not the received e-mail is the 
instruction e-mail for instructing the monitored image to 
be transmitted. For example, the e-mail analyzing module 
42 extracts a password included in an e-mail, and decides 
whether or not the extracted password matches a 
predetermined password. As a result, when the password 
included in an e-mail matches the predetermined password, 
the e-mail analyzing module 42 can determine that the 
received e-mail is the instruction e-mail. As another 
simple method, the e-mail analyzing module 42 extracts an 
address of a transmitting source of the received e-mail, 
and decides whether or not the extracted address of a 
transmitting source matches a predetermined address. As a 
result, when the address matches the predetermined 
address, the e-mail analyzing module 42 can also 
determine that the received e-mail is the instruction e- 
mail . 
[0036] 

The e-mail automatic generating module 43 is 
software for automatically generating an e-mail including 
the monitored image photographed by the digital camera 
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120 and sound data recorded by the sound-collecting 
microphone 140. 
[0037] 

The e-mail automatic transmitting receiving module 
5 44 is software for automatically transmitting an e-mail 
generated by the e-mail automatic generating module 43, 
and for automatically receiving the instruction e-mail. 
Meanwhile, a transmission destination of an e-mail is set 
to an e-mail address of a previously-registered observer. 
10 [0038] 

Meanwhile, each of the above modules may be provided 
as a subroutine of a program, or may be provided as an 
independent program. It is not necessary that the modules 
are collectively installed in a single recording medium. 
15 [0039] 

As adding to the above main program 4 0, the 
following data file is provided to automatically generate 
an e-mail including the monitored image and the like, and 
automatically transmitting the generated e-mail. 
20 [0040] 

An image file 50 is a file for temporarily storing 
an image photographed by the digital camera 120. A sound 
file 60 is a file for temporarily storing sound data 
recorded by the sound-collecting microphone 140. 
25 [0041] 

A text data file 70 is a file for storing a variety 
of messages used as a main text part of an e-mail when 
the e-mail automatic generating module 43 generates the 
e-mail. Specifically, the text data file 70 stores a 
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variety of messages as text data, such as "an intruder is 
detected", "water leak is detected", and "since an 
instruction for transmitting an image is received, a 
current image is transmitted" . 
5 [0042] 

A transmission destination file 80 is a file for 
previously registering a transmission destination address 
used as a destination when the e-mail automatic 
transmitting receiving module 44 automatically transmits 
10 an e-mail. Specifically, an input of the transmission 
destination address is received, and the transmission 
destination address inputted from a key board and the 
like is stored in the transmission destination file 80. 
[0043] 

15 A surveillance method will be described, which uses 

a surveillance system configured as above. 
[0044] 

Figure 3 is a flowchart illustrating a procedure in 
which an e-mail including the monitored image is 
20 generated, and is transmitted when a sensor senses the 
abnormality . 
[0045] 

At step S100, it is decided whether or not the 
sensor 110 senses the presence of a person, the 
25 occurrence of water leak, and the like. More specifically, 
it is decided whether or not a signal from the sensor 110 
which has sensed the presence of a person and the like is 
received through the peripheral device interface 20. When 
the sensor 110 senses the presence of a person and the 
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like (S100: YES), it proceeds to step S102, and when the 
sensor 110 does not sense (S100: NO), it waits until the 
sensor 110 senses. Meanwhile, when the signal from the 
sensor 110 which has sensed the presence of a person and 
5 the like is received, the waking-up module 41 is 

activated, the e-mail automatic generating module 43 is 
waked up, and an e-mail including the monitored image and 
sound data is generated and transmitted as described 
below . 
10 [0046] 

At step S101, the monitored image photographed by 
the digital camera 120 is obtained. The image 
photographed by the digital camera 120 is temporarily 
stored in the image file 50. Thus, the image stored in 
15 the image file 50 is obtained. Meanwhile, instead of the 
digital camera 120, an analog-type camera and an analog- 
type video camera can be used. In this case, it is 
necessary to analog-digital convert an analog image. 
[0047] 

20 At step S102, sound data recorded by the sound- 

collecting microphone 140 is obtained. This sound data is 
analog-digital converted, and is temporarily stored in 
the sound file 60. At step S102, the sound data stored in 
this sound file 60 is obtained. 

25 [0048] 

At step S103, a message suitable for the 
circumstance is obtained from the text data file 70. For 
example, when the presence of a person is sensed by the 
sensor 110, a message "an intruder is detected" is 
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obtained. Meanwhile, when a plurality of kinds of sensors 
110 such as a human-body-sensing sensor and a water leak 
sensor are provided, it is necessary to obtain a message 
according to the kind of a sensor that has sensed the 
5 abnormality. In this case, a relation between an input 
port of the peripheral device interface 20 receiving a 
signal from a sensor that has sensed the abnormality and 
the message to be obtained can be stored as a lookup 
table. The controlling means 10 can identify an input 
10 port receiving a signal from the sensor 110, and obtain a 
message suitable for the circumstance from a plurality of 
messages by referring to this lookup table. 
[0049] 

At step S104, a transmission destination address of 
15 an e-mail is obtained from the transmission destination 
file 80. 
[0050] 

At step S105, data obtained in steps S101 to S104 is 
converted to a format in which the data can be 
20 transmitted as an e-mail. When the obtained monitored 

image and sound data are binary data, the binary data is 
converted to an ASCII character code in an encoding 
method referred to as Base 64. 
[0051] 

25 At step S106, an attached file of the image and 

sound data converted at step S105 is added to the message 
obtained at step S103, the message being used as a main 
text part of an e-mail. For example, this e-mail is 
generated in a MIME (Multipurpose Internet Mail 
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Extensions) format. The transmission destination address 
obtained at step S104 is automatically set as a 
destination of the e-mail. 
[0052] 

5 At step S107, the photographing side terminal 130 is 

automatically connected to the Internet 200, and the e- 
mail generated at step S106 is transmitted to an observer 
side. For example, when the photographing side terminal 
130 is connected to the Internet 200 through an internet 

10 provider, a name of a mail server 400 of the provider, 

the mail server 400 including a SMTP server, a POP server 
and the like, other user account information, and the 
like are previously set. In the present embodiment, upon 
completion of the generation of an e-mail, the 

15 photographing side terminal 130 is automatically 

connected to the Internet 200, and transmits the e-mail 
including the monitored image to the observer side. 
Meanwhile, the e-mail is transmitted in accordance with 
SMTP (Simple Mail Transmitting Protocol) . 

20 [0053] 

At step S108, it is decided whether or not a 
confirming mail is received from the observer side 
terminal 300. Preferably, the confirming mail is a return 
mail to the e-mail transmitted at step S107. When the 
25 confirming mail is not received (S108: NO), the process 
returns to S101, and an image and sound data are further 
obtained, an e-mail including the monitored image is 
generated, and the generated e-mail is sequentially 
transmitted to an observer side. Specifically, an e-mail 
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can be generated and transmitted in every fixed time (e.g 
ten minutes) . As a result, the progress after the 
abnormality is sensed can be sequentially reported to an 
observer. When the confirming mail is received (S108: 
YES), the process is terminated. Meanwhile, the 
confirming mail is received in accordance with POP 3 

(Post Office Protocol) and the like. 

[0054] 

As described above, according to the process 
illustrated in Figure 3, when a sensor senses the 
abnormal, an e-mail including the monitored image is 
automatically generated and transmitted to an observer 
side. The observer can see the monitored image with a 
computer and a portable phone which are the observer side 
terminals . 
[0055] 

In Figure 3, when the sensor 110 senses the abnormal, 
while such a case is described that an e-mail including 
the monitored image is automatically generated, and the 
generated e-mail is transmitted to an observer of a 
predetermined transmission destination, the e-mail 
including the monitored image can be also generated and 
transmitted, regardless of the presence of an event 
sensed by the sensor, based on an instruction from an 
observer for transmitting the monitored image. 
[0056] 

Figure 4 is a flowchart illustrating a procedure in 
which the e-mail including the monitored image is 
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generated and transmitted when an instruction for 
transmitting the monitored image is received. 
[0057] 

At step S200, it is decided whether or not an e-mail 
5 is newly received through the network interface 30. For 
example, by running the e-mail automatic transmitting 
receiving module 44, it is confirmed every certain time 
whether or not a new e-mail is received in an own e-mail 
box. When an e-mail is newly received (S200: YES), it 
10 further proceeds to step S201, and when the e-mail is not 
newly received (S200: NO), it waits until the e-mail is 
received. 
[0058] 

At step S201, it is decided whether or not the 
15 received e-mail includes a password, and the like. As a 
result, it is decided whether or not the received e-mail 
is an instruction e-mail for transmitting the monitored 
image from an observer. Specifically, the e-mail 
analyzing module 42 analyzes content of the e-mail, 
20 thereby extracts the password included in the e-mail, and 
decides whether or not the extracted password matches a 
predetermined password. As a result, when the extracted 
password matches a predetermined password, it is decided 
that the received mail is an instruction e-mail. As 
25 receiving a decision result, the waking-up module 41 
wakes up the e-mail automatic generating module 43. 
[0059] 
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The process of steps S202 to S209 is the same as 
that of steps S101 to S108, so that the detailed 
description will be omitted. 
[0060] 

5 As described above, according to the process 

illustrated in Figure 4, when an instruction e-mail for 
instructing the monitored image to be transmitted is 
received from the observer side terminal 300, an e-mail 
including the monitored image is automatically generated 
10 and transmitted to an observer side. Thus, the observer 
can obtain the monitored image whenever the observer 
needs to see the current monitored image. 
[0061] 

Next, a display example of the observer side 
15 terminal will be illustrated when a surveillance method 
according to the present invention is used. 
[0062] 

Figure 5 illustrates the display example of the 
observer side terminal. 
20 [0063] 

As illustrated in Figure 3, when the sensor 110 
senses the presence of a person, and as illustrated in 
Figure 4, when the observer gives an instruction for 
transmitting an e-mail including the monitored image, the 
25 e-mail including the monitored image is transmitted from 
the photographing side terminal 130 to the observer side 
terminal 300 to be stored in a receiving mail box. 
[0064] 
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In this case, as illustrated in Figure 5 (A) , such a 
fact is displayed on a display of the observer side 
terminal 300 that a new mail has arrived. The new mail is 
received in accordance with a protocol such as POP 3 and 
5 IMAP (Internet Message Access Protocol) . The observer 

side terminal 300 can sequentially display whether or not 
a new mail has arrived by confirming the receiving mail 
box in every fixed time. Such a fact can be also reported 
with sound that the new mail has arrived. 
10 [0065] 

The observer, who knows that the new mail has 
arrived, can confirm content of the e-mail by performing 
a prescribed button operation. In this case, as 
illustrated in Figure 5 (B) , for example, a message 
15 according to the circumstance, such as "an intruder is 
sensed", is displayed as a main text of the e-mail. 
[0066] 

Furthermore, the observer can display the developed 
monitored image on the display by designating the 
20 monitored image and performing a prescribed button 
operation . 
[0067] 

Figure 6 illustrates an example of the monitored 
image displayed on the display of the observer side 
25 terminal. Figure 6 (A) illustrates an example of the 

monitored image automatically transmitted by using an e- 
mail when a sensor senses the presence of a person, and 
Figure 6 (B) illustrates an example of the monitored 
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image automatically transmitted by using an e-mail when a 

sensor senses the presence of water leak. 

[0068] 

The observer can not only see the above monitored 
5 images, but also can hear sound. For example, by 

designating sound file added as an attached file and 
performing a prescribed button operation, sound data is 
developed, and a sound is outputted from a speaker. 
[0069] 

10 As described above, according to the present 

embodiment, without providing a centrally-monitoring 
controlling center apparatus and a dedicated security 
system, by using an e-mail function of the Internet 
widely used at home and at an office, it is possible to 

15 easily monitor the circumstance inside a room in which no 
person is staying. 
[Second Embodiment ] 

The second embodiment relates to a case where a file 
including the monitored image is transferred to a WWW 

20 server, and the monitored circumstance is shown to a 
specific observer on a web site, and thereby the 
surveillance is conducted. Meanwhile, a network 
configuration of the second embodiment is the same as 
that of the first embodiment, so that the description 

25 will be omitted. The same code is attached to the same 
component as that of the first embodiment. 
[0070] 

Figure 7 is a block diagram describing an internal 
configuration of the photographing side terminal 130 of 
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the present embodiment. Instead of the e-mail automatic 
generating module 43 illustrated in Figure 2, a transfer 
file automatic generating module 45 and a file automatic 
transferring module 46 are provided. 
5 [0071] 

The waking-up module 41 receives a signal from the 
sensor 110 that has sensed the abnormality such as the 
presence of a person and water leak, and wakes up the 
following transfer file automatic generating module 45 

10 and file automatic transferring module 46. The waking-up 
module 41 can wake up the following transfer file 
automatic generating module 45 and file automatic 
transferring module 46 by receiving an instruction 
information for instructing the monitored image to be 

15 transferred from a WWW server 500. Meanwhile, the 

transfer instruction information by the WWW server 500 is 
outputted based on an instruction from the instruction 
observer side terminal 300. 
[0072] 

20 The transfer file automatic generating module 45 is 

software for automatically generating a transfer file 
including the monitored image photographed by the digital 
camera 120 and sound data recorded by the sound- 
collecting microphone 140. The generated transfer file 

25 further includes a user ID issued for each observer. 
[0073] 

The file automatic transferring module 46 is 
software for automatically transferring a file generated 
by the transfer file automatic generating module 45 to 
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the WWW server 500. Meanwhile, the destination to which 
the file is transferred is automatically set in 
accordance with a previously registered IP address of the 
WWW server 500. 
5 [0074] 

Each of the above modules may be provided as a 
subroutine of a program, or may be provided as an 
independent program. It is not necessary to install each 
program in a recording medium as a whole. 
10 [0075] 

The image file 50, the sound file 60, the text data 
file 70, and the transmission destination file 80 are 
provided to automatically generate a transfer file 
including the monitored image, and the like and a user ID 

15 specified for each observer who desires surveillance, and 
automatically transfer the generated transfer file. 
Content of each file is roughly the same as that 
described in Figure 2. However, an IP address of the WWW 
server 500, which is a transferring destination of the 

20 file, is stored in the transmission destination file 80. 
[0076] 

Figure 8 is a block diagram describing an internal 
configuration of the WWW server. The WWW server 500 is a 
server for managing a web site providing the surveillance 
25 information such as the monitored image and sound data, 
and for example, is a computer such as an engineering 
work station. 
[0077] 
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Controlling means 510 includes CPU (Central 
Processing Unit) , and controls the whole of WWW server 
500. Meanwhile, the WWW server 500 includes a RAM 
temporarily storing data, a ROM storing a control program, 
5 and a hard disk which can record a variety of programs 
and data files, which are not illustrated respectively. 
[0078] 

A network interface 520 is an interface for mutually 
communicatively connecting to the photographing side 
10 terminal 130, the observer side terminal 300, and the 

like. An observer who desires to monitor can access the 
WWW server 500 from any terminal. 
[0079] 

A main program 530 is, for example, installed in a 
15 hard disk. This main program 530 is executed by the 
controlling means 510, and a variety of functions are 
brought out . 
[0080] 

The main program 530 will be described for each 
20 function module. The main program 530 includes each 
following module. 
[0081] 

A user ID-password setting module 531 is software 
for issuing and setting a user ID and a password. An 
25 observer (user) which desires to utilize this web site 
designates a URL by using a web browser (hereinafter, 
referred to as "browser") installed in each terminal as 
software for browsing web content on a web, and accesses 
this WWW server. Each observer previously performs a 
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user-registration by inputting after-mentioned user 
information. As receiving this result, the user ID- 
password setting module 531 issues the user ID and the 
password to each observer, and relates the issued user ID 
5 and password with the user information to store. 
[0082] 

A file receiving module 532 is software for 
receiving a transfer file transferred from the 
photographing side terminal 130. Meanwhile, such a case 

10 where a file is transferred from the photographing side 
terminal 130 includes such a case where a file transfer 
is instructed by an after-mentioned transfer instruction 
transmitting receiving module 534, and such a case where 
a file including the monitored image is automatically 

15 transferred from the photographing side terminal 130 
since the sensor 110 senses the presence of a person. 
[0083] 

A user ID-password identifying module 533 is 
software for deciding whether or not an observer which 

20 accesses the WWW server 500 is a registered user. 

Specifically, the user ID-password identifying module 533 
identifies information including the user ID and password 
which are inputted by each observer on a screen of a 
browser in each terminal, and are transferred to the WWW 

25 server 500. Next, the user ID-password identifying module 
533 decides whether or not the user ID and password 
inputted by the observer correspond to the predetermined 
user ID and password. As a result, when the user ID and 
password inputted by the observer correspond to the 
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predetermined user ID and password, it can be decided 
that the observer which accesses is a registered user. 
[0084] 

A transfer instruction transmitting receiving module 
534 is software for receiving a transfer instruction 
instructed from the observer side terminal 300, and 
instructing the photographing side terminal 130 to 
transfer a file based on the received instruction. When 
the observer, a registered user, instructs the monitored 
image to be transferred, the WWW server 500 instructs the 
photographing side terminal 130 to generate and transfer 
a file including the monitored image. 
[0085] 

A screen guiding module 535 is software for changing 
a screen outputted to the observer side terminal 300, i.e 
a screen displayed by a browser of each terminal in 
accordance with a link between each page. 
[0086] 

A data retrieving module 536 is software for 
retrieving the monitored image, and the like stored for 
each observer based on the user ID and the password. 
[0087] 

As described above, an observer which desires that 
the monitored information is provided and managed by 
utilizing this web site can register user information, 
and each observer who becomes a registered user can 
instruct the current monitored image to be transferred, 
or can see the monitored image which has been already 
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stored for each observer. Thus, the following data file 

is provided. 

[0088] 

A received image file 540 stores the monitored image 
5 included in a transfer file transferred from the 

photographing side terminal 130. A received sound file 
550 stores sound data included in the transfer file. A 
received text file 560 stores a text message included in 
the transfer file. A user file 570 stores user 
10 information inputted when each observer performs a user- 
registration . 
[0089] 

A charge file 580 stores charge information for each 
observer. Meanwhile, the observer can be charged 
15 according to the number of times in which each observer 

browses the monitored image, or can be charged in a fixed 
amount according to a contract regardless of the number 
of times of the browsing. 
[0090] 

20 A display data file 590 stores an icon on a display 

screen, a pattern, a title, and data of other design 
factor . 
[0091] 

A surveillance method using a surveillance system 
25 configured as above will be described. 
[0092] 

Figure 9 is a flowchart illustrating a procedure of 
the photographing side terminal. 
[0093] 
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At step S300, it is decided whether or not it is 
instructed to transfer a transfer file including the 
monitored image. It is instructed by the WWW server 500 
based on an instruction by an observer, a registered user, 
5 from the observer side terminal 300 to transfer a file. 
It may be instructed by an e-mail, or by transferring 
transfer instruction information as a file in accordance 
with FTP (File Transfer Protocol) to transfer a file. 
When it is instructed to transfer a file, it proceeds to 
10 step S302. On the other hand, when it is not instructed 
to transfer a file, it proceeds to step S301. 
[0094] 

At step S301, it is decided whether or not the 
sensor 110 senses the presence of a person, and the like. 
15 When the sensor 110 senses the presence of a person and 
the occurrence of water leak (S301: YES), it proceeds to 
S302, and when the sensor 110 does not sense (S301: NO), 
the process returns to S301. 
[0095] 

20 According to the above process of step S300 and step 

S301, when it is instructed to transfer a file including 
the monitored image from the WWW server 500 which 
receives an instruction from the observer side terminal 
300, or a sensor senses the presence of a person, Step 

25 S302 and the following steps for generating and 
transferring a file are executed. 
[0096] 

At step S302, the monitored image photographed by 
the digital camera 120 is obtained. At step S303, sound 
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data recorded with the photographing is obtained. At step 
S304, a message suitable for the circumstance is obtained. 
[0097] 

At step S305, a transfer destination of a file is 
5 obtained from the transmission destination file 80. 
Particularly, in the present embodiment, a file is 
transferred in accordance with FTP (File Transfer 
Protocol), so that it is necessary to IP-connect the 
photographing side terminal 130 and the WWW server 500. 

10 Thus, an IP address of the WWW server 500 is previously 
set up as transfer destination information. A user 
account necessary for transferring a file to the WWW 
server 500 is also previously set. Meanwhile, the IP 
address of the WWW server 500 can be configured so that 

15 the address is automatically delivered from the WWW 

server 500 to the photographing side terminal 130 of each 
observer when the observer performs a user- registration, 
and is set up. When the address is automatically set up, 
a work load of the observer is reduced. 

20 [0098] 

At step S306, a format of data obtained at step S302 
to step S305 is changed to a format in which the data can 
be transferred as a file. Here, data included in a file 
is generated as HTML text (Hyper Text/Mark up language) . 
25 Thus, decoration information, attribute information, 

hyperlink information, and the like are described in a 

text in accordance with a prescribed format. 

[0099] 
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At step S307, a transfer file is generated. The 
transfer file includes surveillance information such as 
the monitored image, and a user ID and a password which 
are previously issued from the WWW server 500 to be 
5 registered for each observer. Thereby, the WWW server 500 
can know which observer the monitored location 
corresponds to, from the monitored location the transfer 
file including the monitored image being transferred, and 
becomes able to store the monitored image, and the like 
10 for each observer. 
[0100] 

At step S308, the photographing side terminal 130 is 
automatically IP-connected with the WWW server 500, and 
the transfer file generated at step S307 is transferred 
15 to the prescribed WWW server 500. The file is transferred 
in accordance with FTP (File Transfer Protocol) . 
[0101] 

As described above, according to the process 
illustrated in Figure 9, since it is instructed to 

20 transfer a file, the transfer file generated as HTML text, 
the file including the monitored image and sound data, is 
transferred to the WWW server 500. Since a sensor senses 
the presence of a person, the transfer file including the 
monitored image, and the like is also automatically 

25 transferred to the WWW server 500. Based on the 
transferred file, the WWW server 500 can show 
surveillance information on a web site. 
[0102] 
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Figure 10 is a flowchart illustrating a procedure of 
a WWW server which can provide the surveillance 
information . 
[0103] 

5 At step S400, a user ID and a password are issued 

for each observer, and the issued user ID and password 
are set. Specifically, the user ID and the password are 
issued for each observer under such a condition that user 
information such as a name, an address, an e-mail address 

10 of a photographing side, an e-mail address of an observer 
side, and a credit card number is inputted by an observer 
from a browser of each terminal 300, 130, and the like. 
The issued user ID and password are stored for each 
observer in the user file 570 in relation to each user 

15 information. Meanwhile, by this process, the observer 
side and the monitored side are related to each other. 
Meanwhile, the issued user ID and password can be 
configured so as to be automatically delivered to the 
photographing side terminal 130. 

20 [0104] 

At step S401, it is decided whether or not a file is 
transferred from the photographing side terminal 130. 
When the file is transferred, it proceeds to step S402, 
and when the file is not transferred, it proceeds to step 
25 S403. 

[0105] 

At step S402, when a file is transferred from the 
photographing side terminal 130, the transferred file is 
sequentially stored. Thus, when a file including the 
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monitored image is automatically transferred since the 
sensor 110 senses the presence of a person, the 
transferred file is sequentially received, and is stored 
in the WWW server 500 for each observer. 
5 [0106] 

At step S403, it is decided whether or not a URL 
(identifier) is designated from the observer side 
terminal 300, and the WWW server 500 is called. When the 
WWW server 500 is not called (step S403: NO), the process 
10 returns to step S401 to enter a wait state. When the WWW 
server 500 is called, it proceeds to step S404. 
[0107] 

At step S404, the called WWW server 500 outputs a 
screen prompting a user ID and a password to be inputted 
15 to the observer side terminal 300, and displays the 

screen on a screen of the observer side terminal 300. 
[0108] 

At step S405, when a password is inputted by the 
observer side terminal 300, it is decided whether or not 

20 the inputted password matches a password registered in 

the user file 570. When the passwords do not correspond 
to each other (step S405: NO), the process returns to 
step S404, and data of a screen for prompting a user ID 
and a password to be newly inputted is outputted. On the 

25 other hand, when the passwords correspond to each other 
(step S405: YES), it is decided that a registered 
observer accesses, so that it proceeds to step S406. 
[0109] 
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At step S406, the observer is allowed to select the 
current or past surveillance information to be outputted, 
and data of a display screen for prompting the selection 
is outputted to the observer side terminal 300. 
5 [0110] 

At step S407, it is decided from the observer side 
terminal 300 whether or not the current surveillance 
information is selected to be outputted. Specifically, 
since the observer selects the current surveillance 

10 information to be outputted with a browser of the 

observer side terminal 300, an instruction for outputting 
the current surveillance information is transferred to 
the WWW server 500. When the current surveillance 
information is selected to be outputted from the observer 

15 side terminal 300 (S407: YES), the process of step S408 
is executed, and when the current surveillance 
information is not selected (S407: NO), the process of 
step S410 is executed. 
[0111] 

20 At step S408, when the current surveillance 

information is selected to be outputted, an instruction 
for generating and transferring a transfer file including 
the monitored image and sound data is transmitted to the 
photographing side terminal 130. The transfer of an image 

25 from the WWW server 500 to the photographing side 

terminal 130 can be instructed by a file transfer with a 

file transfer protocol, and an e-mail. 

[0112] 
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At step S409, the transfer file transferred from the 
photographing side terminal 130 is received. 
[0113] 

Thus, when the current surveillance information is 
selected to be outputted, the WWW server 500 instructs an 
address of the photographing side terminal 130 related by 
the inputted user ID and password to transfer a file 
including the new surveillance information, and receives 
the transferred file including the newly-obtained 
surveillance information . 
[0114] 

On the other hand, at step S410, it is decided 
whether or not the past surveillance information is 
selected to be outputted. When the past surveillance 
information is not selected (S410: NO), the process 
returns to step S407. Thus, the process returns to the 
state in which a selection screen is outputted for 
prompting a user to select an operation for obtaining the 
current surveillance information or an operation for 
confirming the past surveillance information. When the 
past surveillance information is selected, it proceeds to 
step S411. 
[0115] 

At step S411, the surveillance information 
corresponding to the observer designated by the user ID 
and the password is laid out based on decoration 
information, attribution information, hyper link 
information, and the like. In other words, when the 
current surveillance information is selected to be 
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outputted, the new surveillance information including the 
current monitored image is laid out based on a data file 
newly generated and transferred in the photographing side 
terminal 130. On the other hand, when the past 
5 surveillance information is selected to be outputted, 
data is read from each of files 540 to 570 which are 
automatically transferred from the photographing side 
terminal 130 in response to the abnormality sensed by the 
sensor 110 in past, and are recorded in relation to the 
10 user ID and the password, and the surveillance 

information including the past monitored image is laid 
out . 
[0116] 

At step S412, the laid out surveillance information 
15 is outputted as a HTML text to the observer side terminal 
300, and the surveillance information desired by the 
observer is provided. 
[0117] 

Next, an example of a display screen of the observer 
20 side terminal 300 will be described. 
[0118] 

Figure 11 is a screen for prompting a user ID and a 
password of the observer to be inputted. On this screen, 
each observer inputs the user ID and the password. 
25 [0119] 

Figure 12 is a screen for prompting operations for 
obtaining the current surveillance information or 
confirming the past surveillance information to be 
selected. On a screen illustrated in Figure 11, when the 
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inputted user ID and password match the previously-set 
user ID and password, it is confirmed that the observer 
is a registered observer, and it moves to a screen 
illustrated in Figure 12. In an example illustrated in 
Figure 12, the observer selects a desired process from "1 
See the current circumstance", "2. Presence of a sensed 
event", "3. See the past circumstance", and "4. Delete 
data" . 
[0120] 

When "See the current circumstance" is selected on a 
display screen of Figure 12, the surveillance information 
including the current monitored image is outputted. 
Figure 13 illustrates a display example of the current 
monitored image. The observer can hear sound by selecting 
"Hear sound" . 
[0121] 

When "Presence of a sensed event" is selected on a 
display screen of Figure 12, the WWW server 500 displays 
the number of times in which the transfer file including 
the monitored image, and the like is automatically 
transferred from the photographing side, and the like in 
response to the presence of a person sensed by the sensor 
110. When the surveillance information has not been 
transferred in past, a message such as "No sensed event" 
is displayed as illustrated in Figure 14, and when the 
transfer file including the surveillance information, and 
the like has been transferred in past, a message such as 
"There is one sensed event" is displayed as illustrated 
in Figure 15. Specifically, the WWW server 500 records 
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the number of times in which a file including the 
monitored image is transferred from the photographing 
side terminal 130 for each observer, and outputs the 
message according to the number of times of the 
recordings . 
[0122] 

When "See the past circumstance" is selected on a 
display screen of Figure 12, or "See image" is selected 
in Figure 15, as illustrated in Figure 16, the past 
monitored image is read from a file which is 
automatically transferred from the photographing side 
terminal 130 in response to the abnormality sensed by the 
sensor 110, and is stored, and the read monitored image 
is displayed. 
[0123] 

As described above, according to the present 
embodiment, without providing a managing center and a 
dedicated security system for centralized surveillance by 
utilizing a web site of the Internet which is widely used 
at home and at an office, the surveillance information 
can be provided, which is used to easily monitor the 
circumstance inside a room where no person is present. 
The observer can freely select and confirm the current 
and past monitored image. Even when the plurality of 
observers are registered in this web site, the 
surveillance information is managed for each observer 
(for each monitoring group) based on identification 
information such as a user ID and a password, so that own 
surveillance information can be certainly confirmed. 



English translation of Japanese Patent Laid-Open No. 2002-042273 
[0124] 

As described above, in view of easily conducting 
surveillance by utilizing the Internet widely used at 
home and at an office, while it is desirable to monitor 
5 by using an e-mail or a file transfer function of the 
Internet, the present invention is not limited to this 
embodiment. For example, it is possible to communicate 
image information and recorded sound data between 
portable phones because of the advance of a mobile 

10 communication network. Thus, when an input of 

transmission destination information (e.g. telephone 
number) for identifying a transmission destination is 
received, the inputted transmission destination 
information is previously registered, and the abnormality 

15 is detected by a sensor, data including the photographed 
monitored image is generated, and the generated data can 
be also transmitted to the transmission destination 
identified based on the registered transmission 
destination information . 

20 [0125] 

In the above embodiment, the monitoring is 
controlled by each controlling means 10 that executes a 
prescribed program describing the above procedure (refer 
to Figure 3, Figure 4, Figure 7, and the like), and this 
25 prescribed program may be provided by using a computer- 
readable medium (e.g., a floppy (registered trademark) 
disk, a CD-ROM, and the like) . This prescribed program 
may be also provided as application software for 
executing each of the above processes. 
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[0126] 

The above embodiment is not described to limit the 
present invention, and a variety of modifications may be 
applied by those skilled in the art within a scope of a 
5 technical concept of the present invention. For example, 
the present invention may be utilized not only to monitor 
an intruder, but also to remotely confirm the state of an 
aged person and a baby which need care. 
[0127] 

10 [Advantages of the Invention] 

According to the surveillance method or the 
surveillance apparatus described in claims 1 and 8, an 
input of the transmission destination information is 
previously received, and when the abnormality is sensed 

15 by a sensor, data including the photographed monitored 
image is generated and transmitted, so that a personal 
user can freely input each transmission destination 
information, and when the abnormality is induced, can 
receive data including the monitored image at each 

20 terminal. Thus, it becomes unnecessary to provide a 
dedicated security center apparatus for centralized 
surveillance, and to allocate a special guard. 
[0128] 

According to the surveillance method or the 
25 surveillance apparatus described in claims 2 and 9, data 
including the photographed monitored image is generated 
in an e-mail format, and the generated e-mail is 
transmitted to the previously-registered transmission 
destination address, so that the surveillance can be 
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conducted by utilizing an e-mail function of the Internet 
which is widely used at home and at an office, and it 
does not become to provide a dedicated line and a 
dedicated image transmitting system for the monitoring, 
and a monitoring technology, which is suitable for a 
general personal user to easily monitor the circumstance 
inside a room where no person is present, can be provided. 
[0129] 

According to the surveillance method described in 
claim 3, the sensor is a human-body-sensing sensor, and 
when the sensor senses a person, an e-mail including the 
photographed monitored image is generated, so that only 
when the presence of a person such as an intruder is 
sensed, the monitored image can be transmitted by e-mail, 
and the general personal user can know the presence of 
the intruder. 
[0130] 

According to the surveillance method or the 
surveillance apparatus described in claims 4 and 10, when 
the instruction information is received, the e-mail 
including the photographed monitored image is generated, 
and the generated e-mail is transmitted to the 
previously- registered transmission destination address , 
so that the observer can always obtain the current 
monitored image through an e-mail by instructing the 
monitored image to be transmitted. 
[0131] 

According to the surveillance method or the 
surveillance apparatus described in claims 5 and 11, the 
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e-mail including the monitored image further includes the 
recorded sound data, so that the observer can not only 
see the monitored image, but also hear the recorded sound 
with a simple method, an e-mail. 
5 [0132] 

According to the surveillance method described in 
claim 6, when the abnormality is sensed, a file including 
the photographed monitored image and the identification 
information specified for each observer who desires 

10 surveillance is generated, and the generated file is 
transferred to a server, and when the identification 
information is required to be included, the monitored 
image is outputted from the server based on the 
transferred file, so that the observer can see the 

15 monitored image through a web site. Thus, the observer 

can know that the abnormality is induced in the monitored 
location by browsing the web site from a terminal which 
is widely used at home and at an office. In addition, own 
monitored image is not seen by an outsider. 

20 [0133] 

According to the surveillance method described in 
claim 7, when the instruction information is received, a 
data file including the photographed monitored image and 
the identification information specified for each 
25 observer who desires surveillance is generated, and the 
generated data file is transferred to a server, so that 
the observer can always instruct the transmission 
including an image. Particularly, since the 
identification information is shared between members of a 
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family or between colleagues in an office, each of all 
members of the family and the like can monitor the 
circumstance of their own home, on the other hand, the 
circumstance of their own home is not monitored by an 
5 outsider. 
[0134] 

According to the computer-readable recording medium 
described in claims 12 and 13, by causing a normal 
computer to read the recording medium to execute, the 

10 surveillance method that enables small scale individuals 
to simply conduct surveillance can be implemented, and 
this surveillance method can be implemented by using a 
normal personal computer, a digital camera, and the like 
without providing a dedicated apparatus configuration. 

15 [0135] 

According to the image information providing method 
described in claim 14, small scale individuals can also 
easily know the circumstance inside a room in which the 
person itself is absent. It is possible to provide a new 

20 type of monitoring service and surveillance information 
providing business in which a person, which desires to 
monitor the circumstance inside a room in which the 
person itself is absent, and the like, can be easily 
registered, and which the person can utilize. 

25 [Brief Description of the Drawings] 
[Figure 1] 

Figure 1 is a block diagram illustrating a network 
configuration according to a surveillance method of the 
present invention . 
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[Figure 2] 

Figure 2 is a block diagram describing an internal 
configuration of a photographing side terminal 
corresponding to a surveillance apparatus of the first 
5 embodiment . 
[Figure 3] 

Figure 3 is a flowchart illustrating a procedure 
when an e-mail including a monitored image is transmitted 
to an observer when a sensor senses the abnormality. 
10 [Figure 4] 

Figure 4 is a flowchart illustrating a procedure 
when an e-mail including the monitored image is 
transmitted to the observer when an instruction for 
transmitting the monitored image is received. 
15 [Figure 5] 

Figure 5 is a diagram illustrating a display example 
of a display of an observer side terminal. 
[Figure 6] 

Figure 6 is a diagram illustrating a display example 
20 when the monitored image is developed on the display of 
the observer side terminal. 
[Figure 7] 

Figure 7 is a block diagram describing an internal 
configuration of a photographing side terminal 
25 corresponding to a surveillance apparatus of the second 
embodiment . 
[Figure 8] 

Figure 8 is a block diagram describing an internal 
configuration of a WWW server of the second embodiment. 

- 51 - 



English translation of Japanese Patent Laid-Open No. 2002-042273 
[Figure 9] 

Figure 9 is a flowchart illustrating a procedure of 
the photographing side terminal corresponding to the 
surveillance apparatus of the second embodiment. 
5 [Figure 10] 

Figure 10 is a flowchart illustrating a procedure of 
the WWW server of the second embodiment. 
[Figure 11] 

Figure 11 is an example of a screen prompting a user 
10 ID and a password of the observer to be inputted. 
[Figure 12] 

Figure 12 is an example of a screen prompting to 
select an operation for obtaining the current 
surveillance information or an operation for confirming 
15 the past surveillance information. 
[Figure 13] 

Figure 13 is an example of a screen displaying the 
current monitored image. 
[Figure 14] 

20 Figure 14 is an example of a screen displaying the 

presence of a sensed event. 
[Figure 15] 

Figure 15 is an example of a screen displaying the 
presence of a sensed event. 
25 [Figure 16] 

Figure 16 is an example of a screen displaying the 
past monitored image. 
[Description of Symbols] 
100 . . . monitoring unit 
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110 . 


. . sensor 


120 . 


. . digital camera 


130 . 


. . photographing side terminal 


140 . 


. . sound-collecting microphone 


200 . 


. . Internet 


300 . 


. . observer side terminal 


400 . 


. . mail server 


500 . 


. . WWW server 
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Figure 1 
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Figure 5 (B) 
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5400 Set user ID and password 

5401 Is file transferred? 

5402 Store file 

5403 Call? 

5 S404 Receive user ID and password 

5405 Does password match? 

5406 Output selection instructing screen to observer 
side 

5407 Is current surveillance information selected? 

10 S408 Instruct photographing side terminal to transfer 

5409 Is file received from photographing side 

5410 Is past surveillance information selected? 

5411 Lay out corresponding data 

5412 Output to observer side 



15 



20 



Figure 11 

#1 Welcome to monitoring site 
#2 Input user ID 

#3 Input password 



Figure 12 

#1 MR. XX, welcome 

#2 Menu 

#3 1 . See the current circumstance 

25 #4 2. Presence of sensed event 

#5 3. See the past circumstance 

#6 4. Delete data 

Figure 13 
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#1 Current circumstance 

#2 Hear sound 

#3 Return to menu 



5 Figure 14 

#1 Presence of past sensed event 

#2 There is one sensed event 
#3 See image 
#4 Return to menu 

10 

Figure 15 

#1 Presence of sensed event 
#2 No sensed event 
#3 Return to menu 

15 

Figure 16 

#1 Past sensed circumstance 

#2 Hear sound 

#3 Return to menu 
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^^-A'«rfflv^raa«i«cia»snfcEaii*<o-«t 

[0 0 6 8 ] £fc s J^±*IM^ISI 
tm5fcWi<, *7**B<£ Mx. 

[0 0 6 9 ] £LbQ£?{^ #HJtogffilc Jcfttf, ft* 

(SJ2<£>||jfi^ffi) *2w»itt SaBBSr^tr 
7r-f/vSrWWWf^KSL, fi£a#S*r.»^:/f- 
■*f M^t<??f {If Rt$ w tia otSffi^rff 

[0 0 7 0 ] H 7 14, *^*3#*^*5JtS«»W** 1 

(Sg77-i'^e»fN^5? 3 u-^4 5, ^i^7 

[0 0 7 1 ] je®j^i^a.-^4 1 f±, A^#ffi^7K«itb 
40 *(D*»Sr«ftjLfc-feV* I 1 0^Mf^£gfsU « 
T^^^r^/^g»i{^^v ; ^^4 5 

^§■1*08*^-^4 e tiB»ft*a B *fc, 

in, g£aB«»te£Sr^1-5Jg^ffi««: 
te^T-f/l-&l&^|*^v > ^"/l-4 5*3J:(J!77^H 

3 0 o^&©*B^ic»-jv^TBa*s^5o 

[0 0 7 2] te3i^r-f^S«]^^v > ^-^4 5 it, 
so 7^A^7i 2 0JiiJ;or*»S»tfcftaB«*5J: 
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[0 0 7 3] 7r-f/Va»(B^^a-^4.6«, ^ 

£3vCV>5WWW1^-^5 0 0OIP7 KU^f^Lfc^ 
[0 0 7 4] 3fc*5, J^lW^^^i-Mi, ^©^P 

?7&<W7 Fist LTfflift£*i/tvvt * 

[0075] *fc ^Mk*£E«&#2i-*&efi 

-^7r^70, i(f*7r^/v8 ojWBfcSJvtv* 

[0 0 7 6] H8tt, WWW*- ^©ftai5«*t»K-*- 
5fc#)CD:/t2 y^Bt?fc5 0 WWWf-^5 £ 

[0077] ifl^asioit CPU 
W) «r&Ve*3 9, WWWt^5 0 0©4WM 
It^ WWWt-/<5 0 0ft, #*H^LTV^ji 

AjX^% 0 

[0 0 7 8] *y 2 0I±, ft 

*»•*- v^ftia wwwf-^ 

[0 0 7 9] ^^y^P^7A5 3 0fJ N K 

looso] ^^yyp^Asao^il^^^v 

[00 8 1 ] 3-— f*I D— — KIR** 5** — ^5 



(8) #12 0 0 2-42 2 7 3 
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3 1 ft, f I D^/** 7- KfcWrU KftrSfc 
^coyy h ^ms, h«fJJl£# 

y&HEi-sfc&roy:? h ?^T^ br*JB*Ki>f 

ttT, 9*1 D— ^17- KRft*^*— 
io ;V5 3llt #RWtJMfc:»— 9*1 D, *3J:W^T7— 
KMfifrU Mlfc^fl D^J:t>vU7-K^, 

[00 8 2 ] 7r-f/*«^-^5 3 2ft, iil&felj 

[00 8 3 ] ID-^y-Kffl^^/V5 
3 3tt* WWWf-^5 0 OtCT^ir^Lfc^^S 
ftcx-if t? & ft35*53&»tt IJ BMf* fc&0> y 7 h ^^Tt* 
. fcS* AftiftfclBu a-f 1 I Dw«!7 — KBJHKei** 
3 3 » % #ffifi:i;oX»^^t57 , 7') 

*©iir®±-eA^*tir, wwwt-/^5oortss 
ft/c^-D* i DteJ;^* KSr^tpffraitliSiJi- 

[oo84] (asjftsaaw^s?*^ ^5 3 

SiaWtaMoKSStSSLfcWfcii, www 

*- ^5 0 ott, tmwmm sowl-c, 

40 [0 0 8 5 ] TO^f^ffl^e ;i/5 3 5 ft, ^ 

r^co y ^ ufc^ox, 3 o o t-tti^-r 

spfffis i-&^*>, frjHTS^^^fc^orji^SJx 

[0 0 8 6 ] 3 6 f±, 3.-* 

[0 0 8 7] a±©J;5fc, ^T>^y*^ h^JfflLT 
BBI(M©HWJ:llWft*at6ia*tt, 

50 KMBtw»i-5ifc*t?*, «*3L— ^t3*ofc«ai 
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«*#Mfcfi*S*L , rv^Kaiir«ft4rS:J! I 5C 

[0 0 8 8] g{fjI(I>7 7^/l'5 4 0H ft&WVI*l 
3 0 frblBSk £ iifzfcM? r 4 Mz&izftZ KawiftSr 

OH fil7 7^f/H^I^6^yt-^»W 

5 HSfc Kid * jH 5 a — ? £fe$TT S 0 
[0 0 8 9] 11*77^5 8 0 H JSiJfcSfcfe 
«8W5 a ftfc\ #^##EfflIflfe£ 

[0 0 9 0] ^7^7 7^5 9 0(1 S^M± 

.©7V = >\ Silt, Z<Dm<D?if t 4y&m<o 
[0 0 9 1] KioiSlcHrtSiiSEa^^ASrtt 
[0 0 9 2] [19H «*««S^Aaai#J«Sr*Lfc7 
[0 0 9 3] Xfy7S3 0 0tli, Effiiij&£3*pe 

#W*3 0 0/5^©fei:i^v^, WWWt-^5 

TP (77>f4«17P>3^) [:Lfc^oT77^^ 

•frlJltt, ^fy7S3 0 2 fcHtPc — # % 7 7-f/KD 
(Gait^ftV^teH:, ^r^S 3 0 1 }-iM? e 
[0 0 9 4] XTyZ^S 3 0 ITU tyfllOW 

O^A©ffft J ^»^©*^*28ftlLfc*&^^» (S3 
0 1 : YES) , ^7y7S 3 0 2i^ii^ JBJwLXV^ 
ftV>*£fci (S 3 0 1 : NO) , XTy?S 3 0 1 \ZM 

[0 0 9 5] to^7^7 9 S 3 00 ^7^yS30 
Xfy7S 3 0 2TOl<77^^ 

«>fft5fc*j £ v teiis^a^ ft $ ft a o 

[0 0 9 6] X7-y7$ 3 0 2X11 ? *J $ friz * y 1 
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[0 0 9 7] ^75/7S 3 0 5T11 7 7>f^KlJfe 

d&i^TH FTP (7z>f/^i7nh3/i/) 
#o"C, ^r^A'OSatfTSfc*^ 3 0 

fcWWW*w<5 0 0 4:W;IPlSRi"S^S^&So U 
1t&^x, £9ljfetiMR£ Lrwwwif— /< 5 0 0 <7) I P 
T Kl^jPttlllMry y!/£jvCV*5. ^c, WW 

1fT#£^ K^ov^Tts»*(I^R3tStX,5 D ft*3> WW 
io wi ^,<5 0 oco I PT K Ka#3&s^— ifSft 

fcfTofcBtfc, wwwt-^5 0 0^P>#eat©8» 
•1**1 3 0K#LTB»WlcE«U tyhr^S 

[00 9 8 ] X^r^^S 3 0 6til J*^ 77*8302 
^f5/7S 3 0 5T«|^fc7- ^OTfeSfr^T-Y 

/HE3|-c#5»S;ic:«Si-<5 D 7r^f^4* 

ft^r^ H HTML^Cf x^r* h ■ t— 

20 ^ry^fB) T?fpj«S*LS B Ufc*SoT\ JMSflWR^ 

[00 9 9] ^7S'7'S 3 0 7XU Sl77^f/« 
iS^^x^o ft*3, (KaS^T^^fctt, KfflW«ftif©E 

ffi^r, stft^tiT^s^— f id^7- 
^f>titi/^ 0 rtttcJ: ot, wwwih— 0 0 

tptesi 7 7 ^*ea $ n x * & s r t , 

so fc^W«**;|ft|frr S riff 

ft5„ 

[0100] ^f^S 3 0 8T*H ftjgfflj$B*l 3 0 
H SiSji^wwwf^ 5 0 0 t I P^iK^tt, *x 
jy^S 3 0 7-^rtSitfc(aS7r-f^0f3eowww 

f^5 0 0^^6 ? ft*5, 7 7-f/^iSH 
FTP fcLfci&SoTfftafc 

.So 

[0101] BJKO^ilC, H9[^^*Lfc*Q.ffi{Cj:*L 

40 (fc^ff^ - * sr^rtp h t m l xmxipf& z frtz^m 7 

7^f^WWWt^5 0 OlZlgl$^ a ir>- 

f^tf^77'f^, i 0 0 

teai^^bfc7 7^^^V>r, WWW 
t^5 0 0H }*±X% *a««Sr^BB"r 

[0 10 2] mi OH KttflMBftUffel-iBrtas-C* 

6 Q 

50 [0 103] ^7y^S4 0 0T*H *Sa#glJ^^— 
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ID&£T$s*A7-V&WlM$ZiZ> e JWfrttfctt, Ktt 

ID:fcJ:tM*I7-KH:, #3t-lPflWli: 
■«<Jrj-feixra-^r-f A^s 7 ortfc*K»#»JK: 

[0 10 4] XrivyS4 0 K'Et ftlMMM)£l 3 0 

^fc7r^;v ©teStf *> 5 a> S*> trWKf 1"* • fe^ 5 fo 

[0 10 5] X^S4 0 2ft, 1UeH**l 3 0^ 
*S*fl1-5 0 UJot, t^fll 0^A£># 

& s a«**t, #tatjrwwwf-/<5 oo» 

[0 10 6] ^Ty^S 4 0 Ea#««*3 0 

l^SHHi (^77^S40 3 : NO) , ^7y/S40 

y?S4 o 4— ast> 0 

iira*rai#«»*3oofcffi*u ^m#«*3 

[0 10 8] ^^540 5^ i£S#«*30 

K#— SLfcV^frfrti: (^f ^S40 5 : NO) , * 
7 7^840 4(11^ (ffcta- fl r>&£X$s<XV 

*t7-K#-&T5»££|± Ufy^S4 0 5 : YE 
S) , a»S4iTV^6E«»fciSr^'tr^'Xf*6i*l| 

[0 10 9] ^7^54 0 6tU 3 0 

[0 110] ^7^S4 0 7m S8t«iS*3 0 
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ws^naoi:, wwwt-^ s o o *^aS£©RW 

(S40 7 : YES) , 7ry/S 40 8 ©JliltfS 
ft. IR$^tv>4:v^le:H; (S 4 0 7 : NO) , * 
7^^S4 10 <0&m& £ }i£ 0 

[oiii] ^7^s4 o 8m affi^Ktatta© 

7^^©ff^J:0*na*^asaHS**iSa WWWir- 
^5 0 0^ &I»NI« 1 3 0 7 

[0112] ^77^54 0 »^«^1 30 

[0 113] Lfc^oT, a4©Kfflfll«^ffl*«l!^s 

jSRSjLfca-e-^tt. wwwt-^5o o f±, a* 

i 3 ocor Ku*fc#Lt, mztmmum 

[0114] — 7°S4 1 Otll, ffi*<DEfc 
SftTV^ftV*^** (S 4 1 0 : NO) , 

30 ^S4 1 1 iilittPp 

[0115] ^7J/^S 4 1 lTttx 1F I D*3*tf 

40 LTj«tt«* 1 3 0^&g«ft|£6%S 

StttV^#77-f /1^5 4 0~5 7 0?^£> 

[01 16] X-7^7 P S4 1 2m M'TfrJ-atLfc 
feS«*3&5, HTML*»i:bre«#fl!HB*3 0 0fc 

[0117] K^K%#UiR**«3 0 0 <z>*^pfffi© 

so [0118] Bint Kffi#<P3.— If i d $5 
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£<DBft1f»ttfBft if ©5i« Srffi-t-Hffi-Cfc ^ ill 

M*, ♦WteRSSitr^S^— 9*id*sJ:0« 

rfcOTHBStu, ll 2fc#4*L5WB5»Ji»fi l i-5 li [1 
i2i^S*LfcWTftt, ri. 

[0120] H l 2 ^^Bffi-b-c r^fficotfeffi^a 

m^^ti^, hi 3 m£<o&m»<D»w9i&&L 

[0121] Hi 2<z>^BE_ht* rtfjnw#*j 

wwwfw^ 5 o o i±, t 1 1 o J: 

*A«B#«a tr, gaft£ft»«i*>bB 

ttMMf tf SraS y r -Y S *tT v * a SHfctt ^ 

tf, III 4(c^£ftaJ; r«*ibrv^*-8:A/j ft if 

£ 0 AflcWi-H, wwwf-^sooH BflPWfe-&d 

[0 12 2] |12©^Sffit ri§£0>:RffiSr&<5j 

ofc<t5S^©«to{^i:rg»wiii»a^ifi»*i 30 

[0 12 3] «±©J;5f-, *StK»*icJ:ntf, 

fcfe<, &<nm j ¥m&\z%&hx^%<<(>'?-*yh 

[0124] ft*, BJLbttH Lfc J: 5 fc:, $e*flt»fc: 
£ < Lfc ^ ;y * ±y K Sr^Jffl Ltll^ifcffl 
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B*M**A,«^-**fMfcU «ft*nr^ft5S« 

[0125] ft*, ±»Lfc*ra»IC»Vvt, Bft® 

ffl», ilBUfcffl-a^lffi (El 3, 14, *JktfB7» 

YV^Tk L,xmfc£ftXh&\<\ 
20 [0126] K±KB8Lfc*»B»a, 

ttHrt^*5i^Ta«#lJ:J: m&x&z> a 
[0127] 

[^^*]ff^l N SfclB«©Bffi***fcfiB 
r-^Sraft^S^t^t?*^. Lfc^oT, **BW 

sffim^iaa-rs^n^ft < fts 0 
[oi28] »**2, 9 K:nit«>Bfttrtt*fef±Ba 

m^-/^tg^jffiLr^m^ : fT5^^^'c^, b% 

fca«ft<ft9, -««XBAa—5 , dS|B*ftK:, 
£ftft£S:B«r5©l;:iS LfcBfflR«Sr-Ji^r5r.i: 

[oi29] is*«3 fcia«©Ba*tsfc mia 

•fe^tt, AS^^f-^S)*), -fcv^fcJzoTAfcJBJH 
«A#ftif©A«>#ftSr*ftiUt»frfcw 



2i 

t o 1 3 o ] k*^4 , i o teE*©ea*&*fctte 

LTWB1-«OT* BS#li, E»M**>»«»*ftfr 

E*Mfeftft#i-a ^ ir^-C ft 5, 
[0 13 1] IS*^5 S 1 1 |CE«^E«*»*«:W:E 

[0 13 2] B**6fclE«©Ka*ftfcJ:ixK, Sft 
ft«ftLfc#-&fc s ^£ftfcKt&B«£Effift*S!-r 

ftffcftU, #*StLfc7r-<^*f—^J*au MS 
/vfcS<5v *T MB* 6> BftMlfeft ffi* t5©^ 

p^im* hfciic-c, wmmm*&z>^k 
ifls-c*5 B ifc^ot, Ktt^K»icje< * 

#n«IB^a«f(l»ft****wi^J:oT, sag*© 

ife*355#*a*«>ftRftBai-5rta*-c*5-ar, » 

[0 13 4] 1 3i£fE*<^^t 0 ^-*gE 

JfrT*r fcjftitf*, »ffl<0*lMlrtftKH-5ri&<, 

v^r, r<oRa*ttftsafrr*w4ds^*5 0 

10 13 5] 4i=i|B««>M«flM8««*»fcJ: 
irft«*fcj3!5^tas-ct5. iB«o;Fft*<0£ 

rt&^ftEaLfc^fflA35Sffi^Sfti-§c 
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«Mft*+7ny*BT?*>S. 

[b 2 ] si <^Mm 6*a»nte*fj«-r* 

[03] -feVf-^S^ft^Lfc^^, gmnftft 

IB 4] E«W«^iSHS»^ftg«Lfc»*lc:, g« 
ft* Lfc^n-^^r-b-e* So 

[05] Ka#aas*«? x a * -? w © m^m ft^i- 

B~e&5 0 

[^ e ] m»»nmm<o w ±-?Bank# 

SW$ttfc»&<o«^ft*-fB-e*)So 
[B7] * 2 <®£ft&tt fcWtS Wl««K:#Jt1-* 

20 £ 0 

[B S ] IS 2 Cfctt5WWW*w<Ort» 
[B 9 ] m 2 <0WK»«fc*5tf SRa»«fc#JtS1-8 

©seisms** ifc7u^-h-efc5 fl 

[Hi 0 ] JB2 ©*JBBl|Bte»lt5WWll--^©«! 
[Hill] Effi#<03-— * lDjej;^Jxy— y<dk 

30 «flWftif©»Rftffi-rBBO-«Tfc5o 

[B 1 3 ] ^<orai(«ft**i-5Biif©--*!l'C*> 

[Bui «to©#«ft»*i-«iirK«>--«T?*)S. 
[us] «toco#*ifts*i-5ir®«?-t(-e*)S 0 
Hie] AH^etiBftft^-rsBBw-w^* 
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